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Abstract 

Problem statement: Two of the techniques used in the meta-analysis of 
single-case research are calculating the percentage of nonoverlapping data 
(PND) and the percentage of data points that exceed the median of the 
baseline phase (PEM). The PND is a nonparametric approach in which the 
researcher calculates the percentage of data points in the treatment phase 
that exceed the highest point of the baseline phase's distribution (or the 
lowest point if the targeted behavior is a problem behavior to be reduced). 
Even though PND can be calculated easily, it has a disadvantage if there is 
even one data point in the baseline phase over the top or below the bottom 
level, the PND score for that treatment phase is calculated as zero. 
Calculating the PEM was introduced in order to overcome this 
disadvantage. In this approach the effect size is calculated by finding the 
median of the baseline phase and drawing a horizontal line from this 
point through the intervention phase and then determining the percentage 
of data points over this line (or below this line for the problem behaviors). 
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Purpose of study: The purpose of this study was to investigate the 
effectiveness of the intervention studies that used single-subject design 
and targeted children and individuals with autism in Turkey. 

Methods: Researchers reviewed studies conducted from 1990 to 2010 and 
calculated the PND and PEM scores for the selected studies. The 
researchers selected dissertations or studies that were published in peer 
reviewed journals that included intervention methods to teach 
skills/behaviors or reduce problem behaviors. Five articles, seven master's 
theses, and four doctoral dissertations were included. 

Findings and results: The mean effect sizes for the 14 studies were .85 for 
PND and .90 for PEM. The most effective intervention methods for 
teaching skills/behaviors and reducing problem behaviors are listed. 

Conclusions and recommendations: The results of this study are discussed in 
terms of findings, the characteristics and limitations of the intervention 
methods and the characteristics of the study groups. 


Keywords: Autism, effect size, intervention, single-subject design 


Autism is a complex and life-long developmental disability that can affect 
individuals in different ways and to different degrees (Wall, 2004). In order to 
diagnose the symptoms of autism in general terms, the following three areas are 
assessed: a) language and communication disorders, lacking symbolic play and 
imagination; b) problems in social relationships and social interactions; and c) 
repetitive, ritualized and stereotypical behaviors, and limited interests (Amerikan 
Psikiyatri Birligi, 2001; Korkmaz, 2005). Individuals with autism have complex and 
diverse characteristics; therefore they need intervention programs that are 
developmentally appropriate and effective in order to support multiple areas of 
development (Prizant & Rubin, 1999). Moreover, experts and teachers emphasize 
that they must be provided with individualized and efficacious strategies to help 
these individuals benefit from education (Lee, Simpson, & Shogren, 2007). On the 
other hand, intervention methods have been developed for teaching new skills and 
changing the problem behaviors of children with autism; however, the debates and 
arguments are still continuing over which strategies are most effective due to the 
controversial intervention treatments used in the field. Therefore, the literature 
strongly emphasized the need to identify intervention methods that are more 
effective for children with autism. 

For the past three decades, the number of studies conducted with children and 
adolescents with autism in Turkey has increased. In addition, various intervention 
techniques —promising to parents of children and adolescents with autism but 
lacking scientific evidence such as dolphin therapy and sensory integration—are 
being used in several special education institutions. On the other hand, university 
special education units prefer applied behavior analysis techniques, while graduate 
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research studies prefer single-subject research designs that make it possible to work 
with one or more subjects and examine the effects of an intervention on subjects 7 
behaviors separately (Kircaali-iftar & Tekin, 1997). However, the evidence regarding 
effectiveness or the effect sizes of these studies is lacking. 

The effect size is a statistical score that shows the effect of the independent 
variable on the dependent variable, and it can take values from zero to one 
(Buyiikozturk, Bokeoglu, & Koklii, 2008). Researchers have been trying to develop 
acceptable statistical methods to investigate the effect sizes of intervention techniques 
using single-subject research designs (Wolery, Busick, Reichow, & Barton, 2010). 
Various meta-analysis studies have used several techniques such as mean baseline 
reduction, percentage of zero data, and regression based ^-statistics in order to 
objectively and quantitatively determine the findings of single-subject experimental 
designs in which the data are shown graphically (Allison & Gorman, 1993; Skiba, 
Casey, & Center, 1985-1986 as cited in Ma, 2009). However, the disadvantages of 
these techniques, such as the difficulty in calculating the effect sizes and the 
occasional information loss while using these techniques, are being discussed as 
current issues. Mastropieri and Scruggs (1985-1986) suggested using the percentage 
of nonoverlapping data (PND) to calculate the effect sizes of intervention methods 
used in single-subject experimental designs, and they accepted the PND scores as an 
indicator of the effect sizes of the studies that examine the efficacy of early 
intervention on socially withdrawn children. The existent literature shows research 
findings that demonstrate that the PND, when implemented correctly, is as effective 
as any other approach to conducting a meta-analysis of single-subject experimental 
designs (Campbell, 2003, 2004; Olive & Smith, 2005). The PND approach has the 
advantages of being easily calculated and its findings can be easily interpreted 
quantitatively while also being criticized in some points (Preston & Carter, 2009). For 
example, Ma (2009) stated that if there are data points in the baseline phase over the 
top or below the bottom level of the data points in the intervention phase, the PND 
score for that treatment phase is lower than expected, meaning that the intervention 
is interpreted as ineffective. Therefore, in order to eliminate the disadvantages of the 
PND, Ma (2006) introduced calculating the percentage of data points exceeding the 
median of baseline phase (PEM). Even though there is evidence that the correlation 
between researcher judgment and the PEM is higher than the PND (Ma, 2006), it has 
been seen that the PND approach is more widely used than the PEM approach. On 
the other hand, Preston and Carter (2009) found that it is important to calculate the 
effect sizes of intervention methods conducted by single-subject experimental 
designs with more than one approach, and the scores found using these two 
approaches should match each other. The PND and PEM scores can be calculated for 
any single-case design if there are data points in the baseline and treatment phases. 

Review studies of treatment methods used with children with autism try to 
determine the most effective intervention methods. Campbell (2003) examined the 
effects of behavioral techniques on problem behaviors by conducting a meta-analysis 
and he found no difference between the efficacies of using aversive stimulus, positive 
methods, these two methods together or extinction on the problem behaviors of 
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children with autism. He determined that all four behavioral strategies were 
significantly effective in reducing inappropriate behaviors of individuals with 
autism. Another meta-analysis study calculated the effect sizes of 11 studies focusing 
on self-management of learners with autism using the PND approach. This study 
also compared the impact of intervention programs based on variables such as 
instruction materials, participants characteristics, intervention characteristics, target 
behaviors (positive or negative), and type of trainers (Lee et al., 2007). This study 
calculated 78 PND scores and the mean effect size for self-management intervention 
programs was .81, meaning that these programs were generally effective in terms of 
Scruggs and Mastropieri's criteria (1998). 

Ma (2009) reviewed 163 studies using the PEM approach and examined the 
effectiveness of intervention methods such as systematic desensitization, self-control, 
instruction, usage of positive reinforcement and punishment as well as use of 
preferred reinforcement on the behaviors of individuals with autism. He calculated 
1502 effect sizes and found the mean effect size of six methods (systematic 
desensitization, priming, self-control, training, positive reinforcement and 
punishment, and presenting preferential activities or reinforcers) to reduce problem 
behaviors was more than .90. In addition, he stated the interventions were more 
effective on social behaviors, language skills, and attention of individuals with 
autism (the effect sizes were larger than .90), and the most difficult behavior to teach 
individuals with autism was taking the perspective of others (the effect size was 
.67).Recently, single-subject experimental designs have been used especially in 
studies targeting children and adolescents with autism in Turkey (e.g., Akmanoglu, 
2008; Altunel, 2007; Ardig, 2008; (^uhadar, 2008; Kurt, 2006; Ulke-Kiirkguoglu, 2007) 
that investigated the impact of intervention methods on these children's behaviors. 
Examining these research studies, it can be seen that researchers have used various 
methods to decrease inappropriate behaviors and increase appropriate behaviors. 
However, Turkish literature has not investigated the findings indicating the 
effectiveness or effect sizes of these methods. On this account, it is important to 
determine effective intervention methods to increase positive behaviors and reduce 
problem behaviors in children with autism. It is also essential to assess the power of 
the findings obtained from more than one study. Therefore, the purpose of this study 
was to assess the effect sizes of intervention methods used with children and 
individuals with autism conducted by using single-subject experimental research 
from 1990 to 2010 in Turkey, by calculating the PND and PEM values. 


Method 

Identification and Selection of Studies 

Published articles, unpublished master's theses and doctoral dissertations were 
reviewed through online data bases of the libraries of the universities and the 
Documentation Center of Higher Education Council in order to identify the single¬ 
subject studies of individuals with autism. These searches used keywords such as 
autism, autism spectrum disorders, autistic disorder, single-subject design, and meta- 
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analysis. The following criteria were determined to select the studies: (1) the 
intervention was conducted with children and adolescents with autism; (2) the study 
was either a master's thesis, a doctoral dissertation or an article published in a peer 
reviewed journal; (3) there were data points in the baseline and treatment phases and 
there was no gap between the baseline and the treatment level; (4) the study data 
were graphically represented (Mastropieri & Scruggs, 1985-1986); and (5) there were 
more than three data points in both the baseline and the treatment phases (Wolery et 
al., 2010). After identifying the studies, five articles, eight master's theses, and four 
doctoral dissertations focusing on children and adolescents with autism from 1990 to 
2010 were selected. One of the master's theses was excluded from this study because 
the graphical representation showed only the last three data points of the treatment 
phase (Gori§, 2006). In addition, two other master's theses in which a specific 
intervention method was not used were also excluded from this review (Ardig, 2008; 
Yazkag, 2001). At the end of the selection procedure, a total of 14 single-subject 
studies examining the effectiveness of intervention strategies on the behaviors of 
individuals with autism were included. Lipsey and Wilson (2001) emphasized that 
even if many studies about the same constructs are needed to conduct a meta¬ 
analysis, if the studies that include the same ideas and relationships and the results 
can be compared and organized in comparable forms of statistics, it is possible to 
conduct a meta-analysis. Therefore, in this study, although there were a limited 
number of single-subject studies including individuals with autism in Turkey, a 
meta-analysis was conducted and the effect sizes of the intervention strategies used 
in these research studies were calculated. 

In nine of the studies, a multiple probe design was used (Akmanoglu, 2008; 
Akmanoglu & Batu, 2004; Altunel, 2007; Canay, 2003; (Juhadar, 2008; Dogru, Onal, & 
Bek, 2007; Kanpolat, 2008; Tekin-iftar, 2008; Yilmaz, Birkan, Konukman, & Erkan, 
2005). One of the remaining studies used an adapted alternating treatment design 
(Kurt, 2006) and another used a multiple baseline design across behaviors (Birkan, 
1999). One of the remaining studies was conducted with a multi-element treatment 
design (A-B-A-C-A-BC) (Ulke-Kiirkguoglu, 2007) and another one was conducted 
with A-B-A-B design (Esirgemez, 1999). The last study was conducted with an A-B 
design (Giiltekin, 1999). The studies in this review were categorized in terms of their 
independent variables (intervention strategies). The independent variables of the 
studies reviewed here are errorless teaching methods (simultaneous prompting, 
constant time delay, graduated guidance, most to least promoting, adapting 
antecedent prompts), direct teaching, teaching activity schedules, and offering choice 
opportunities. The dependent variables of the studies, or the behaviors to be changed 
using intervention programs, are protecting oneself from the lures of strangers, 
community and leisure skills, identifying items of clothing that are named and 
presented by computers, shopping, answering questions, balance-wheeled bicycle 
riding, task engagement and self stimulatory behaviors, pointing to numerals that 
are named, following instructions, aquatic play skills, and inappropriate behaviors 
(noncompliance and walking around). Table 1 presents the summaries of the 
research studies of children and adolescents with autism. 
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Table 1 

Summary of the Studies 


Authors 

# of 

subjects 

Diagnosis 

Ages 

Research 

Design 

M\ 

G* 

Dependent variables 

Akmanoglu (2008) 

4 

Autism 

6-11 

Multiple probe design across subjects 

M\G 

Protecting oneself from the lures of strangers 

Guhadar 

(2008) 

3 

Autism 

4-6 

Multiple probe design with probe conditions across 
subjects 

M\G 

Engagement in activities, leisure skills (hitting 
pins, toy building using bricks, sticking Mr. 
Potato Man) 

Identifying items of clothing that are named and 
presented by computers 

Community skills (shopping) 

Kanpolat 

(2008) 

Tekin-Iftar (2008) 

3 

Autism 

8-12 

Multiple probe design across subjects 

M\G 

3 

Autism, 

■m 1^ 1 

7-9 

Multiple probe design with probe conditions across 

non aTrinre 

M\G 

Altunel 

(2007) 

Dogru et al. (2007) 

3 

retardation 

Autism 

5-7 

Ut:lLaV lUIb 

Multiple probe design with probe conditions across 

non aArinrc 

M\G 

Answering questions (where, when, and what 
happens) verbally 

Balance wheeled bicycle riding skill 

3 

Autism 

3-6 

Ut;lLclV lUii> 

Multiple probe design with probe conditions across 
subjects 

Multi-element treatment design (A-B-A-C-A-BC) 

M\G 

Ulke-Kiirkqiioglu 

(2007) 

Kurt 

(2006) 

4 

Autism 

5-8 

- 

Task engagement and self-stimulatory behaviors 

4 

Autism 

6-8 

Adapted alternating treatment design 

M 

Leisure skills (takingpictures with a camera and 
playing CD on a CD player) 

llmaz et al. 

(2005) 

Akmanoglu & Batu 
(2004) 

Canay 

(2003) 

Birkan 

(1999) 

Esirgemez (1999) 
Giiltekin 
(1999) 

4 

Autism 

7-9 

Multiple probe design with probe conditions across 

non 

M\G 

Aquatic play skills (aquatic kangaroo, cycling, 
and snake play) 

Pointing to numerals that are named 

3 

Autism 

6-17 

Ut:ILaV lUIb 

Multiple probe design across subjects 

M\G 

3 

Autism 

5-6 

Multiple probe design with probe conditions across 
subjects 

Multiple probe design across behaviors 

M\G 

Following instructions 

1 

Autism 

4 

- 

Following instructions 

2 

2 

Autism 

Autism 

5-8 

A-B-A-B 

A-B 

- 

Task engagement 

Inappropriate behaviors (noncompliance, 
walking around) and incompatible behaviors 
(compliance, task engagement) 


M: maintenance , G: generalization 
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Calculating the Effect Sizes 

This study calculated the effect sizes of each intervention strategy by using the 
PND and PEM approaches, but the effect sizes for generalization and maintenance 
phases were not calculated. For a multi-element treatment design, the effect sizes 
were calculated for each phase. Then, because the treatment in this design provided 
choices within, between, and within and between activities, it was thought that all 
treatment phases could be combined as " providing choice opportunities/' and the 
mean of all the PND and PEM scores for the treatment phases were calculated. For 
the reversal design, for every AB phase, the PND and PEM scores were calculated 
separately, and the average scores for every child and study were calculated. 

The PND was calculated as Mastropieri and Scruggs (1985-1986) described. The 
highest data point (for the problem behaviors to be reduced the lowest point) in the 
baseline level was found and a horizontal line was drawn from this point through 
the end of the treatment level. Second, the number of data points above this line in 
the treatment level (or below for the problem behaviors) was divided by the number 
of data points in this level. The PND score results from this operation. As suggested 
by Scruggs, Mastropieri, Cook, and Escobar (1986), a PND score above .90 shows that 
the intervention is very effective, a score between .70-.90 indicates it is quite effective; 
scores between .50 and .69 mean it is a little effective and a score below .50 shows 
that the intervention is ineffective. 

The PEM score for every study was calculated as Ma (2006) described, and the 
median of the data points in the baseline level was found. One of the limitations of 
the PND approach in which even though there is only one data point of zero (or 100 
for the behaviors to be reduced) in the baseline level is that the PND score is also 
zero and the intervention that is ineffective eliminated. Then, the data points in the 
baseline level were ranked from the lowest to the highest. If the total number of data 
points in the baseline level was odd, the data point in the middle was the median. If 
the total number of data points was even, the average of two data points remaining 
in the middle of all data points was the median. Then a horizontal line was drawn 
from this median point through the treatment level. Later, for the behaviors to be 
increased, the number of data points over this line (or for the behaviors to be 
decreased, the number of data points below this line) was divided by the total 
number of data points in the treatment level. The result gives the PEM score. The 
PEM scores can be higher than the PND scores because a median line of the data 
points in the baseline level is drawn. The PEM scores are interpreted like PND 
scores —more than.90 means very effective, .70-.90 effective, .50-.69 a little effective 
and below .49 is ineffective (Ma, 2006). 

In this meta-analysis, the PND and PEM scores were calculated separately for 
every graphical representation, participant, and intervention method. Because it 
would cause misconceptions to give all the effect sizes calculated, the mean of the 
PND and PEM scores were calculated (Lee et al., 2007) so that only one PND and one 
PEM score was obtained for every intervention strategy. Table 2 lists the average 
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effect sizes obtained for every study (or intervention method) reviewed in 
analysis. 

Table 2 

The PND and PEM Scores of the Studies' Independent Variables 

this meta- 

Independent Variable 

Study 

PND 

PEM 

Simultaneous prompting 

Kanpolat (2008) 

1.00 

1.00 

procedure 

Tekin-Iftar (2008) 

1.00 

1.00 


Akmanoglu & Batu 

.69 

.82 


(2004) 

.78 

.78 


Altunel (2007) 



Constant time delay procedure 

Kurt (2007) 

1.00 

1.00 


Yilmaz et al. (2005) 

.79 

.79 

Graduated guidance 

Akmanoglu (2008) 

.49 

.49 

Most to least prompting 

Canay (2003) 

1.00 

1.00 

procedure 




Adapting antecedent prompts 

Birkan (1999) 

.81 

.90 

procedure 




Direct teaching 

Dogru et al. (2007) 

1.00 

1.00 



.98 

1.00 


Esirgemez (1999) 

.82 

.98 


Giiltekin (1999) 



Activity schedules 

Cuhadar (2008) 

.96 

.96 

Offering choice opportunities 

Ulke-Kiirkguoglu (2007) 

.79 

.91 


Inter-coder reliability 

The second author calculated 114 effect sizes for 14 studies reviewed in this study 
and then the first author calculated the PND and PEM scores for 30 percent of the 
effect sizes. Inter-coder reliability was calculated by the formula of "number of 
agreements on calculations/number of all the calculations X 100" (Kircaali-Iftar & 
Tekin, 1997). The initial inter-coder reliability was 87 percent. The disagreements 
between the coders were resolved by discussing the PND and PEM values until the 
same scores were obtained. 
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Results 

A total of 114 effect sizes were calculated in the meta-analysis of 14 studies of 
children and adolescents with autism in Turkey. The average of effect sizes for all the 
interventions was .85 for PND and .90 for PEM (highly effective). On the other hand, 
the study found that offering choice opportunities was an effective strategy (Ulke- 
Kurkgiioglu, 2007) to reduce self-stimulatory behaviors and increase task 
engagement (PND=.79, PEM=.91). In addition, parents' use of differential 
reinforcement of incompatible behaviors was also found to be an effective strategy 
for noncompliance (PND=.81, PEM=1.00) and walking around behaviors (PND=.81, 
PEM=1.00) of an individual with autism. 


Discussion and Conclusion 

The results of this meta-analysis show that the intervention methods used with 
children with autism are generally effective. Because the average PND and PEM 
scores for 14 studies (except one study) are more than .85, in terms of effect size 
criteria, intervention methods used with children with autism in Turkey are very 
effective in general (Scruggs et al., 1986; Ma, 2009). One of the outcomes of this study 
indicates that errorless teaching is the most widely used strategy for teaching 
children with autism in Turkey (Akmanoglu, 2008; Akmanoglu & Batu, 2004; 
Altunel, 2007; Birkan, 1999; Canay, 2003; Kanpolat, 2008; Kurt, 2007; Tekin-iftar, 2008; 
Yilmaz et al., 2005). According to the results of this meta-analysis, when the studies 
are reviewed without taking their dependent variables into account, the most 
effective strategies of errorless teaching methods are constant time delay, 
simultaneous prompting, most to least prompting, and adapting antecedent prompts 
procedures. The literature suggests that children with autism benefit from errorless 
teaching, and the effect sizes of these teaching methods are very high (Morse & 
Schuster, 2004). However, in this study, we could not examine which errorless 
teaching methods are more effective on which behaviors or skills of students with 
autism, because there are only a few studies of errorless teaching used with these 
students in Turkey. 

The lowest effect size belongs to the graduated guidance technique of the 
errorless teaching methods (Akmanoglu, 2008). When the PND and PEM scores of 
this strategy are taken into account, graduated guidance is ineffective in teaching 
children to protect themselves from the lures of strangers. However, this finding 
should be interpreted carefully. Since the graduated guidance technique was used in 
only one study with individuals with autism in Turkey, it is impossible to compare 
different studies of graduated guidance at this point. Also, in the treatment level of 
that study, there was no change in the behaviors in the desired way for a very long 
time. On the other hand, Akmanoglu (2008) stated in her study that she did not come 
across any studies related to teaching this skill to children with autism. Future 
studies are needed to determine the efficacy of graduated guidance and the 
effectiveness of this technique on different dependent variables should be 
investigated. 
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Other effective methods include direct teaching, offering choice opportunities, 
and activity schedules. Previous literature suggests that the most effective 
intervention methods used with individuals with autism are priming, self-control, 
reinforcing desired behaviors and punishing undesired behaviors, and offering the 
child or the individual the activity or reinforcement she/he wants (Ma, 2009). As 
seen in Table 1, in Turkey, offering choice opportunities and activity schedules were 
used in only one study; therefore, future research focusing on different methods is 
needed to determine whether these methods are effective on various behaviors or 
skills of children with autism. 

Ma (2006, 2009) stated that calculating PND scores to determine the efficacy of the 
studies may be misleading, and calculating the PEM scores is a more accurate way to 
identify the efficacy of an intervention method. That the PND and PEM scores are 
close to each other indicates that there are no outliers in the baseline level so the PND 
score is not calculated as low (Scruggs, Mastropieri, & Casto, 1987). Therefore, the 
effect sizes of the intervention methods used with individuals with autism in Turkey 
were calculated using both the PND and PEM approaches in this meta-analysis. The 
PND and PEM scores of 11 out of 14 studies were the same, while the scores were 
different for intervention methods such as offering choice opportunities (Ulke- 
Kurkgiioglu, 2007), direct teaching (Giiltekin, 1999) and simultaneous prompting 
procedure (Akmanoglu & Batu, 2004). When the graphical representations of the 
data were examined in these studies, the data points in the baseline level varied in 
studies by Ulke-Kiirkguoglu (2007) and Giiltekin (1999), and some of the data points 
in the treatment level were zero in a study by Akmanoglu and Batu (2004). Ma (2006, 
2009) indicated that even if the treatment seems effective in the graphical 
representation of some studies, the PND score may show the opposite. This is 
evident especially when the data points in the baseline level vary, there is more than 
one data point in the baseline level on the floor (for behaviors to be decreased) or the 
ceiling (for the behaviors to be increased), and the tendencies of the data points vary 
(increases and decreases of the data points in the treatment level coexist). 

The existing literature highlighted the importance of examining treatment 
integrity, and it is accepted as the prerequisite to determine the efficacy of an 
intervention (Preston & Carter, 2009; Wolery et al., 2010). The researchers also stated 
that it is important that each intervention method is carried out in the same way in 
every study and that treatment integrity data are collected. In this meta-analysis, 
treatment integrity data were lacking in only three of 14 studies (Birkan, 1999; 
Esirgemez, 1999; Giiltekin, 1999). Treatment integrity refers to the degree to which a 
researcher implements what she/he intends to in an intervention or the independent 
variable (Peterson, Homer, & Wonderlich 1982; Yeaton & Sechrest, 1981). If no 
treatment integrity data is given in a study, the results and effect size of that 
intervention should be judged carefully. 

Social validity data were missing in eight of 14 studies reviewed here (Altunel, 
2007; Birkan; 1999; Canay, 2003; Dogru et al., 2007; Esirgemez, 1999; Giiltekin, 1999; 
Kanpolat, 2008; Yilmaz et al., 2005). Social validity refers to the participants 7 
perception of how much the effects of the intervention benefited them; it may involve 
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asking the participants about the importance of the purpose of the intervention, the 
appropriateness of the method, and the importance of the effects (Wolf, 1978). If a 
study lacks social validity data, it means the opinions of the individuals who 
participated in that study have not been examined. 

In meta-analysis studies, the effect sizes of the interventions are compared in 
terms of independent variables and dependent variables such as age and gender of 
the participants, settings, or behaviors to be increased or reduced (e.g., Lee et al., 
2007; Ma, 2006). In the current study, the effect sizes of the interventions are only 
compared in terms of independent variables because of the limited number of studies 
conducted with the same intervention method. The design of the study is important 
in calculating effect sizes. For example, reversal models can only be used with 
behaviors that can be reversed; that is to say, when the intervention is withdrawn, 
the behaviors can turn back to the levels in the baseline. However, when the 
intervention was withdrawn in previous research studies, the behaviors sometimes 
did not turn back to the levels in the baseline level (Kazdin, 1982; as cited in Lee et 
al., 2007). Ma (2009) suggests that the PND and PEM scores should not be calculated 
for the AB designs because their internal validity is low. Therefore, even though we 
calculated the effect size of a study in an AB design (Giiltekin, 1999), the results of 
this study should be considered carefully (PND=.82, PEM=.98). 

This meta-analysis should be considered a pilot study that examines the effect 
sizes of intervention methods of single-case designs used with children with autism 
in Turkey. Wolery and his colleagues (2010) emphasized that, in single-subject 
research studies, calculating effect sizes and finding a match between the effect sizes 
and graphical representation of the data (a match between the efficacy of the 
researcher's opinions and the effect size) give more accurate and valid information 
about the intervention method. Therefore, when the studies of single-case designs of 
children with autism increase in Turkey, it will be possible to compare the 
effectiveness of the different methods on different behaviors by calculating the effect 
sizes and to determine the most effective method on behaviors and skills of children 
with autism. In conclusion, although various intervention techniques have been used 
with individuals with autism in Turkey, more studies which examine their 
effectiveness and efficacy are needed. 


31 



32 


Biilbin Sucuoglu & §eyda Demir 


References 

*Akmanoglu, N. (2008). Otistik gocuklara kotii niyetli yabanci ki§ilerin kendilerini kagirma 
girigimlerinden kaginmayi ogretme [Can children with autism learn to protect 
themselves from the lures of strangers?].Unpublished doctoral dissertation, 
Anadolu University, Institute of Educational Sciences, Eskisehir. 

*Akmanoglu, N., & Batu, S. (2004). Teaching pointing to numerals to individuals 
with autism using simultaneous prompting. Education and Training in 
Developmental Disabilities , 39(4), 326-336. 

*Altunel, M. (2007). Otistik dzellikler gosteren ogrencilere soru cevaplama becerilerinin 
ogretiminde kuguk grup duzenlemesi He sunulan e§zamanli ipucuyla ogretimin 
etkililigi [The effectiveness of simultaneous prompting procedure delivered in 
small group teaching arrangement on teaching question answering skills to 
children with autism]. Unpublished master's thesis, Anadolu University, 
Institute of Educational Sciences, Eskisehir. 

Amerikan Psikiyatri Birligi (2001). Diagnostic and statistical manual of mental disorders 
(E. Koroglu Trans.) (4 th ed.). Ankara: Hekimler Yaym Birligi. 

Ardig, A. (2008). Uyarlanmig yogun tuvalet egitimi yonteminin otistik dzellikler gosteren 
gocuklara tuvalet becerilerinin ogretilmesinde etkililigi [The effectiveness of 
modified intensive toilet training method on the teaching toilet skills to 
children with autism]. Unpublished master's thesis, Anadolu University, 
Institute of Educational Sciences, Eskisehir. 

*Birkan, B. (1999). Otistik bir gocuga ogrenmeye hazirlik becerilerinin ogretimi 
[Teaching preparation to learning skills to a child with autism]. Ozel Egitim 
Dergisi, 2(3), 51-57. 

Buyiikozturk, S., Bokeoglu, O. C., & Koklii, N. (2009). Sosyal bilimler igin istatistik (10. 
Bash) [Statistics for social sciences, 3 rd ed.]. Ankara: Pegem Akademi. 

Campbell, J. M. (2003). Efficacy of behavioral intervention for reducing problematic 
behaviors in persons with autism: A quantitative synthesis of single-subject 
research. Research in Developmental Disabilities,24, 120-138. 

Campbell, J. M. (2004). Statistical comparison of four effect sizes for single-subject 
designs. Behavior Modification, 28(2), 234-246. 

*Canay, T. (2003). Otistik gocuklara soylenen komutun yerine getirilmesi becerisinin 
ogretiminde ipucunun giderek azaltilmasiyla ogretimin etkililigi [The 
effectiveness of most to least prompting on teaching to complete basic 
directions to children with autism]. Unpublished master's thesis, Anadolu 
University, Institute of Educational Sciences, Eskisehir. 


References marked with an asterisk indicate studies were included in the meta-analysis 



Eurasian Journal of Educational Research 


33 


*(^uhadar, S. D. (2008). Resimli etkinlik gizelgeleri He sunulan ogretim surecinin otistik 
dzellikler gosteren gocuklann serbest zaman becerilerini ogrenmeleri iizerindeki 
etkililigi [Effectiveness of the instruction realized through activity schedules 
on leisure skills of children with autism]. Unpublished doctoral dissertation, 
Anadolu University, Institute of Educational Sciences, Eski§ehir. 

*Dogru, S. S. Y., Onal, O. B. Y., & Bek, H. (2007). Teaching how to ride a balance 
wheeled bicycle to autistic children using the direct instruction method. Selguk 
University Sosyal Bilimler Enstitusii Dergisi , 18, 245-256. 

*Esirgemez, C. (1999). §ekil verme i§lem surecinin derse dikkat siiresini artirmaya etkililigi 
(otistik gocuklar ornegi) [The effects of shaping procedures in increasing the 
attention behavior to the lessons]. Unpublished master's thesis, Gazi 
University, Institute of Educational Sciences, Ankara. 

Gori§, S. G. (2006). Otistik gocuklar a temel gikarma igleminin kazandinlmasi, surekliligi ve 
genellenebilirliginde uyarlanmig basamaklandinlmi§ ogretim yontemine gore 
hazirlanan ogretim materyalinin etkisi [Determine the effectiveness of the 
instructional materials that were designed according to adaptive stepwise 
instruction upon acquisition, maintenance and generalization of basic 
subtraction skills in autistic children]. Unpublished master's thesis, Gazi 
University, Institute of Educational Sciences, Ankara. 

*Gultekin, E. (1999). Uygun olmayan davramglarm azaltilmasinda ebeveynler tarafindan 
uygulanan uyugmayan davramglann aynmli pekigtirilmesinin etkisi (otistik gocuklar 
ve ebeveynleriyle eve day ah aile egitimi) [Effect of differential reinforcement 
incompatible behaviors applied by parents to decrease the inappropriate 
behavior]. Unpublished master's thesis, Gazi University, Institute of 
Educational Sciences, Ankara. 

*Kanpolat, Y. E. (2008). Otistik bireylere adi soylenen giysiyi gosterme becerisinin 
ogretiminde bilgisayar araciligiyla sunulan egzamanli ipucuyla ogretimin etkililigi. 
[The effectiveness of simultaneous prompting procedure presented by 
computers on teaching the skill of naming the items of clothing to individuals 
with autism]. Unpublished master's thesis, Abant Izzet Baysal University, 
Institute of Social Sciences, Bolu. 

Kircaali-iftar, G., & Tekin, E. (1997). Tek denekli aragtirma yontemleri. [Single-subject 
research designs]. Ankara: Turk Psikologlar Dernegi Yaymlan. 

Korkmaz, B. (2005). Yagmur gocuklar. Otizm nedir? [Rain children. What is autism?], 
istanbul: Kitap Matbaacilik. 

*Kurt, O. (2006). Otistik dzellikler gosteren gocuklar a zincirleme serbest zaman becerilerinin 
ogretiminde sabit bekleme sureli ogretimin ve e§ zamanli ipucuyla ogretimin gomulii 
ogretimle sunulmasimn etkililik ve verimliliklerinin kar§ila§tinlmasi [A comparison 
of constant time delay and simultaneous prompting within embedded 
instruction on teaching chained leisure skills to children with autism]. 


33 



34 


Biilbin Sucuoglu & §eyda Demir 


Unpublished doctoral dissertation, Anadolu University, Institute of 
Educational Sciences, Eskisehir. 

Lee, S. EL, Simpson, R. L., & Shogren, K. A. (2007). Effects and implications of self¬ 
management for students with autism: A meta-analysis. Focus on Autism and 
Other Developmental Disabilities , 22(1), 2-13. 

Lipsey, M. W. & Wilson, D. B. (2001). Practical meta analysis. Applied Social Research 
Methods. London: Sage Publications Inc. 

Ma, H. (2006). An alternative method for quantitative synthesis of single-subject 
researches: Percentage of data points exceeding the median. Behavior 
Modification , 30(5), 598-617. 

Ma, H. (2009). The effectiveness of intervention on the behavior of individuals with 
autism: A meta-analysis using percentage of data points exceeding the 
median of baseline phase (PEM). Behavior Modification, 33 (3), 339-359. 

Mastropieri, M. A., & Scruggs, T. E. (1985-86). Early intervention for socially 
withdrawn children. The Journal of Special Education, 19, 429-441. 

Morse, T. E., & Schuster, J. W. (2004). Simultaneous prompting: A review of the 
literature. Education and Training Developmental Disabilities, 39, 153-168. 

Olive, M. L., & Smith, B. W. (2005). Effect size calculations and single subject 
designs. Educational Psychology, 25(2-3), 313-324. 

Peterson, L., Homer, A., & Wonderlich, S. (1982). The integrity of independent 
variables in behavior analysis. Journal of Applied Behavior Analysis, 15, 477-492. 

Preston, D., & Carter, M. (2009). A review of the efficacy of the picture exchange 
communication system intervention. Journal of Autism and Developmental 
Disorders, 39, 1471-1486. 

Prizant, B., & Rubin, E. (1999). Contemporary issues in interventions for autism 
spectrum disorders: A commentary. The Journal of the Association for Persons 
with Severe Disabilities, 24, 199-208. 

Scruggs, T. E., & Mastropieri, M. A. (1998). Summarizing single-subject research: 
Issues and applications. Behavior Modification, 22(3), 221-242. 

Scruggs, T. E., Mastropieri, M. A., & Casto, G. (1987). The quantitative synthesis of 
single subject research: Methodology and validation. Remedial and Special 
Education, 8(2), 24-33. 

Scruggs, T. E., Mastropieri, M. A., Cook, S. B., & Escobar, C. (1986). Early 
interventions for children with conduct disorders: A quantitative synthesis of 
single-subject research. Behavior Disorders, 11, 260-271. 

*Tekin-iftar, E. (2008). Parent-delivered community-based instruction with 
simultaneous prompting for teaching community skills to children with 



Eurasian Journal of Educational Research 


35 


developmental disabilities. Education and Training in Developmental Disabilities, 
43(2), 249-265. 

*Ulke-Kurkguoglu, B. (2007). Otistik dzellikler gosteren gocuklara birebir ogretimde 
etkinlikler igi ve arasi segim firsatlan sunmamn etkilerinin kar§ila§tmlmasi [A 
comparison the effects of providing choice opportunities within and between 
activities during one-to-one teaching to children with autism spectrum 
disorders]. Unpublished doctoral dissertation, Anadolu University, Institute 
of Educational Sciences, Eski§ehir. 

Wall, K. (2004). Autism and early years practice. A guide for early years professionals, 
teachers and parents. London: Paul Chapman Publishing. 

Wolery, M., Busick, M., Reichow, B. ve Barton, E. E. (2010). Comparison of overlap 
methods for quantitatively synthesizing single-subject data. Journal of Special 
Education , 44,18-28. 

Wolf, M. M. (1978). Social validity: The case for subjective measurement or how 
behavior analysis is finding its heart. Journal of Applied Behavior Analysis, 11, 
203-214. 

Yazkag, P. (2001). Otistik gocuklara iletigimin ogretilmesinde resim dersinin etkililigi 
[Painting course in the teaching process of communication with autistic 
children]. Unpublished master's thesis, Gazi University, Institute of 
Educational Sciences, Ankara. 

Yeaton, W., & Sechrest, L. (1981). Critical dimensions in the choice and maintenance 
of successful treatments: Strength, integrity, and effectiveness. Journal of 
Consulting and Clinical Psychology, 49, 156-167. 

*Yilmaz, I., Birkan, B., Konukman, F., & Erkan, M. (2005). Using a constant time delay 
procedure to teach aquatic play skills to children with autism. Education and 
Training in Developmental Disabilities, 40(2), 171-182. 


Tiirkiye'de Otizmli Ogrencilerle Gergekle§tirilen Davram§sal 
Mudahalelerin Etki Buyiiklukleri 

(Ozet) 

Problem Durumu 

Tek denekli ara§tirma desenleri kullamlarak gergekle§tirilmi§ olan gali§malarm 
etkililigini degerlendirmek iizere kullamlan meta analiz yontemlerinden birisi 
Ortii§meyen Veri Yiizdesinin (OVY) hesaplanmasidir. OVY hem birden fazla 
miidahalenin etki buyukliiklerini kar§ila§tirmak hem de herhangi bir gali§manm etki 
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biiyiikliigiinii hesaplamak igin kullanilabilmektedir. Parametrik olmayan bir 
yakla§im olarak kabul edilen OVY, ba§lama diizeyinin en yiiksek veri noktasimn 
iizerinde kalan miidahale a§amasi veri noktalarimn (uygun olmayan davram§lar 
azaltilmak istendiginde ba§lama duzeyinin en dii§iik veri noktasimn altmda kalan 
veri noktalan) yiizdesidir. Ara§tirmacilar tarafmdan kolayca hesaplanabilen OVY'nin 
onemli bir dezavantaji oldugu, ba§lama diizeyinde en list ya da en altta veri noktasi 
olmasi durumunda OVY degeri sifir olarak bulundugu agiklanmaktadir. Bu durum, 
gorsel veriler mtidahalenin etkili oldugunu gostermesine kar§m mudahalenin etkili 
olmadigimn dii§iiniilmesine neden olabilmektedir. Bu dezavantajm ortadan 
kaldirilmasi igin miidahale yontemlerinin etki biiyiikliiklerinin hesaplanmasmda 
ba§lama duzeyinin ortancasim gegen veri noktalan yiizdesini (BOY) hesaplama 
yakla§immm kullamlmasi onerilmektedir. Bu yakla§ima gore bir ara§tirmanm 
etkililigini hesaplamak igin ba§lama verilerinin ortancasi bulunur, bu noktadan hem 
ba§lama hem de miidahale a§amalarmi igeren X eksenine paralel bir gizgi gizilir. Bu 
ortanca gizgisinin iizerinde kalan (uygun olmayan davram§lar igin ortanca gizgisinin 
altmda kalan) veri noktalarimn yiizdesi hesaplanarak BOY, diger bir deyi§le etki 
biiyiiklugu hesaplanmaktadir. Etki biiyiiklugu .90'm iizerinde olan OVY ve BOY 
degerleri mudahalenin gok etkili, .70-.90 arasi orta derecede etkili, .50-.69 arasi gok az 
etkili oldugunu .50'nin alti ise etkisiz miidahale oldugunu gostermektedir. 

Ara§tirmamn Amaci 

Bu gali§manm amaci Turkiye'de 1990-2010 yillan arasmda otizmli gocuk ve bireylerle 
gergekle§tirilmi§ tek denekli desenlere dayali miidahale ara§tirmalarmm 
etkililiklerini OVY ve BOY yakla§imlanyla incelemektir. 

Ara§tirmanin Yontemi 

1990-2010 yillari arasmda Tiirkiye'de gergekle§tirilen makaleler ve tezler incelenerek 
otizmli bireylere beceri/davram§ kazandirmayi ve uygun olmayan davram§lan 
azaltmayi amaglayan miidahale yontemlerinin kullamldigi tek denekli ara§tirmalar 
belirlenmi§tir. Belirlenen ara§tirmalarda kullamlan miidahale yontemlerinin etki 
biiyiikliikleri OVY ve BOY yakla§imlan kullamlarak analiz edilmi§tir. Buna gore 
otizmli ogrencilerle tek denekli ara§tirma desenleri kullamlarak yapildigi belirlenen 
be§ makale, sekiz yiiksek lisans tezi ve dort doktora tezinden bu gali§ma kriterlerine 
uygun olmadigi belirlenen tig gali§ma meta analiz di§i birakilarak toplamda 14 
gali§ma incelenmi§tir. 

Ara§tirmamn Bulgulan 

Bu gali§mada, otizmli gocuk ve genglere farkli miidahale yontemlerinin uygulandigi 
14 galismamn analizinde, ara§tirmalar bagimsiz degi§kenlere (kullamlan 
ogretim/miidahale yontemlerine) gore gruplanmi§; 12 gali§mada olumlu 
davram§lan artirma, iki gali§mada ise problem davram§lari azaltma yontemlerinin 
kullamldigi belirlenmi§tir. On dort gali§ma igin toplam 114 etki biiyiiklugu 
hesaplanmi§tir. Hesaplanan 114 etki biiyiikliigiiniin %30'u igin kodlayicilar arasi 
giivenirlik incelenmi§tir. Kodlayicilar arasi giivenirlik katsayisimn %87 oldugu 
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bulunmu§tur. Kodlamalardaki anla§mazliklar uzerinde durularak ara§tirmacilar 
arasmda anla§ma saglanmcaya kadar tarti§malar yurutiilmu§ ve hesaplamalarm 
sonuglari aym gikincaya kadar analizler tekrarlanmi§tir. Turn gali§malardan elde 
edilen etki buyukluklerinin genel ortalamasi OVY igin .85 ve BOY igin .90 
bulunmu§tur. Etki buyukliikleri araligi OVY ve BOY degerleri igin .49-1.00 arasmda 
degi§mektedir. Analizler sonucunda 13 gali§ma igin OVY ve BOY degerlerinin 
oldukga yiiksek, bir gali§ma igin bu degerlerin .49 oldugu goriilmu§tur. Hesaplanan 
OVY ve BOY degerlerine bakildigi zaman, kendini uyarma davram§lan ile etkinlikle 
ilgilenmeme davram§im azaltmak igin kullanilan "segim yapma 77 yonteminin OVY 
degerinin .79, BOY degerinin ise .91 oldugu gorulmektedir. Problem davram§lan 
azaltmayi hedefleyen ikinci gali§mada ise yonergeye uymama ve gezinme 
davram§lari, 7/ uyu§mayan davram§larm ayrimli peki§tirmesi 77 ile azaltilmaya 
gali§ilmi§; bu yontemin yonergeye kar§i koyma davram§ma ili§kin OVY degeri .81, 
BOY degeri 1.00 bulunurken, gezinme davram§i igin ise OVY .80 ve BOY 1.00 
oldugu bulunmu§tur. 

Aragtirmamn Sonuglan ve Onerileri 

Bu gali§manm bulgulari genel olarak otizmli gocuklarla kullanilan 
ogretim/miidahale yontemlerinin etkili oldugunu gostermektedir. On dort 
galismanm ortalama OVY ve BOY degerlerinin .85 7 den daha fazla olmasi, etki 
biiyiiklugu olgiitlerine gore otizmli gocuklara uygulanan miidahale yontemlerinin 
genel olarak gok etkili oldugu §eklinde yorumlanabilir. Bu gali§ma sonuglan, 
iilkemizde otizmli gocuklarm egitimi siirecinde en fazla yanli§siz ogretim 
yontemlerinin kullamldigmi gostermi§tir. Analiz sonuglari, /7 her ara§tirmada 
uzerinde gali§ilan bagimli degi§kenler goz online almmaksizm 77 incelendiginde, 
yanli§siz ogretim yontemleri arasmda yer alan ve en etkili goriilen yontemlerin 
77 sabit bekleme siireli ogretim, e§ zamanli ipucuyla ogretim, ipucunun giderek 
azaltilmasiyla ogretim, davram§ oncesi ipuglarimn uyarlanmasiyla ogretim 77 oldugu 
gorulmektedir. Yanli§siz ogretim yontemlerinden olan /7 a§amali yardimla ogretimin" 
etki buyukliigiiniin en dii§iik oldugu gorulmektedir (.49). Yanli§siz ogretim 
yontemleri di§mda en etkili goriilen yontemlerin dogrudan ogretim, segim firsatlari 
sunma ve resimli etkinlik gizelgeleri ile sunulan ogretim siireci oldugu 
gorulmektedir. Bu ara§tirma kapsammda incelenen gali§malarm ll'inde uygulama 
giivenirligi verisi toplandigi, iigiinde ise uygulama guvenirligi verisinin olmadigi 
gorulmektedir. Diger taraftan, incelenen ara§tirmalarm altismda sosyal gegerlige 
ili§kin veri toplandigi, sekizinde ise sosyal gegerlige ili§kin verilerin yer almadigi 
belirlenmi§tir. Bu meta analiz gali§masi iilkemizde, tek denekli gali§malarm etki 
buyukluklerinin incelendigi pilot bir gali§ma olarak kabul edilmelidir. Tek denekli 
ara§tirma yontemlerinin kullamldigi gali§malarda, miidahale yontemlerinin etkililigi 
agiklamrken etki buyukluklerinin de hesaplanmasi ve grafiksel verilerle etki 
biiyiikleri arasmda uyu§ma olup olmadigimn belirlenmesi, bir ba§ka deyi§le, 
ara§tirmacinm yontemin etkisine ili§kin g6rii§ii ile etki buyukliigiiniin uyu§masi, 
uygulanan yontemin etkisine ili§kin daha dogru ve gegerli bilgi vermektedir. Bu 
nedenle sonraki gali§malarda, uygulanan miidahale yontemlerinin grafiksel 
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analizleri yarn sira etki buyukluklerinin hesaplanmasi onemli goriilmektedir. 
Ulkemizde otizmli gocuklarm egitimi/ogretimine odaklanan tek denekli ara§tirma 
sayisi arttikga, ogretim yontemlerinin farkli davram§lar ya da beceriler lizerinde 
etkisinin belirlenmesinin ve yontemlerin etkililiginin kar§ila§tirilmasmm 
ara§tirmacilar igin bir gereklilik oldugu du§unulmektedir. 

Anahtar Sozciikler: Otizm, etki biiyuklugii, miidahale, tek denekli ara§tirma desenleri 



